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Abstract We consider a fixed size population that undergoes an evolution- 
ary adaptation in the weak mutuation rate limit, which we model as a biased 
Langevin process in the genotype space. We show analytically and numeri- 
cally that, if the fitness landscape has a small highly epistatic (rough) and 
time- varying component, then the population genotype exhibits a high effec- 
tive diffusion in the genotype space and is able to escape local fitness minima 
with a large probability. We argue that our principal finding that even very 
small time-dependent fluctuations of fitness can substantially speed up evo- 
lution is valid for a wide class of models. 



1 Introduction 

Organisms adapt to their environment by sequential fixation of beneficial 
mutations. This process is often visualized as motion of a population (spec- 
ified by multi-dimensional genomic variables corresponding to the dominant 
genotype in the population) in the fitness landscape, where the height of the 
landscape corresponds to the reproductive fitness of an average individual in 
the population Jj. Fitness landscapes are believed to be rough with many 
local maxima, and a population may get stuck in one, so that every plausible 
mutation is deleterious. In such cases adaptation to a global fitness maximum 
requires the fixation of deleterious mutations, which is rare. Even when there 
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is a path of only neutral or weakly selective mutations to the global optimum, 
it may be difficult to find it, and navigating such paths can be slow due to 
the low fixation probability 1/7V for a population of N individuals for a 
neutral mutation 

It has been recognized that temporal fluctuations in the fitness landscape 
can drive the population out of a local fitness maximum. For example, the 
maximum of fitness at one time may be on a fitness slope at another time, 
allowing the population to leave the area. Such connections between the fluc- 
tuating selective pressure, the population size, and the population-genetics 
dynamics have been studied extensively starting with the introduc- 

tion of the concept of adaptive topography by Wright [Tl . More recently the 
evolutionary dynamics of density regulated populations in fluctuating envi- 
ronments have been elucidated in more ecologically realistic models [SIEIIZ], 
bridging the gap between the classical population dynamics [SJH] and the 
population genetics models. 

In a recent pioneering numerical evolution experiment [10', these ideas 
were further developed to show that certain type of fluctuating environmental 
pressures speed up evolution many times in a particular model. However, it 
remains unknown to what extent these results generalize. Is the speedup a 
general property? How does it depend on the spatiotemporal structure of 
the fluctuating environment? Can a population escape any local maximum? 
How does the motion in the genotype space depend on time? Do fitness 
fiuctuations have to be dramatic, as in Ref. [10], or can small fluctuations 
still speed the evolution up? 

In this article, we answer some of these questions in the context of a 
model of evolutionary dynamics that is simple enough to allow a thorough 
analytical and numerical treatment, but is at the same time general enough 
so that at least some of our predictions hold for a wide class of evolutionary 
models. We consider the limit of a weak mutation rate, when the time scales 
are well separated. The time between successive mutations is slower that the 
typical flxation time, and the characteristic time scale of the fitness land- 
scape changes is the longest. Further, we assume a constant population size, 
so that the evolutionary dynamics depends only on the relative fitness dif- 
ferences between the genotypes. We consider adaptation in a highly epistatic 
genotypic space, such that the evolution takes place on a one dimensional 
pathway with large, local fitness differences. Under these assumptions, we 
show that the evolutionary search can be sped up substantially when only a 
small component of the fitness landscape undergoes temporal variations. 



2 The model 

Our model of a fiuctuating environment is based on an overdamped Langevin 
particle in a potential. The position x is some generalized coordinate that 
describes the dominant genotype in the population, and hence a change in x 
is a fixation event. This genotype changes with the velocity given by 



dx 
~dt 



1 dU{x,t) 
7 dx 



(1) 
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where U is the potential, 7 is the friction, ?7 is a white Gaussian noise with 
the variance 2D, where D is the intrinsic difFusivity. Notice that in the usual 
physics language, the process will minimize the potential so that U is the 
negative fitness. 

Motion to minimize U represents fixation of beneficial mutations, while 
Langevin noise allows low probability fixation of neutral and deleterious 
mutations. The first phenomenon is called natural selection/drift in evolu- 
tionary/physics languages, and the second is unfortunately referred to as 
drift/diffusion, respectively. To avoid confusion, in the remainder of the ar- 
ticle we use the physics terminology. 

We write the potential as 



This models the emergence of novel functions in a population. Namely, the 
fitness is largely independent of time, as described by Uq. However, small 
temporal changes in fitness are allowed. For example, acquiring an enzyme 
that can metabolize a certain chemical is generally advantageous if the chem- 
ical is present, but somewhat deleterious if it is absent, so that the investment 
into production of the enzyme cannot recovered. We model this by adding 
the small fitness component <P{x) that fluctuates as S{t), representing, for 
example, changes in the availability of the metabolite due to seasonal or 
geological variations. Finally, we choose to separate the global, almost non- 
epistatic, fitness from the local, possibly highly-epistatic (but small) effects 
by making the gradient of Uq smaller than that of <P, even though the scale 
of ^ itself is smaller than that of Uq. 

With the conditions above, we can redefine Uq, 'P, and S without much 
loss of generality, so that {S)t = 0. We then consider the simplest form of 
(l>{x) and S{t) that satisfy these conditions, and we will discuss how our 
results generalize to other forms of the functions in Section [5] Namely, we 
choose to be a zero-mean periodic saw-tooth potential, and S" to be a zero- 
mean periodic telegraph signal. These considerations allow us to write near 
a particular point x in the genotype space 



U{x,t)^Uo{x)+^{x)S{t), 



(2) 



and we focus on the following range of parameters: 



var5(t) - 1, 
max[^(a:)] — 



min[^(a;)] <^ max[t/o(a;)] — min[C/o(a;)] 



(3) 

(4) 



1 dU 



V + (j){x)s{t), 



(5) 



7 dx 



h . \ . TTX 



(6) 




s{t) 



nt 

sign sm — 



(7) 



where v is the intrinsic drift or bias, defined as positive for the drift to the 
right, see Fig. [l] We always assume that \h\/L > |ti|, so that the fluctuating 
component of the potential can actually create local maxima and minima on 
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Fig. 1 The potential U{x,t) at a fixed time. An oscillatory, symmetric, sawtooth 
perturbation is added on top of the average linear potential that creates a drift 
velocity of v. 



top of the global landscape Uo{x). In what follows we denote by T the time 
between subsequent potential flips (the half-period of the fluctuations), and 
L is half of the spatial period. 

This model is similar to various stochastic ratchets considered in the 
literature pT[[T^[T?[|14j . Thus, intuitively, the question of whether the fitness 
fluctuations can speed up the evolutionary search is a question similar to 
whether a rectified or a high- variance motion can appear due to ratcheting. 



2.1 Rescaling of the equation of motion 

Using the choices above, we can rewrite the equation of motion, Eq. ([!]) as 

n T / 

^ = [-cj>{xMt)+v] + V2Drj. (8) 

where 77 is a Gaussian white noise of unit variance. In Eq. ([8|, the dynamics 
explicitly depends on five different parameters L, T, v, h, and D. Neverthe- 
less, by rescaling the time, the space, and the potential as x/L — > x, t/T — ^ t, 
j^cf) — 7> (/), — > w, we can reduce the number of parameters to only three: 
the ratio of the typical diffusion time over half the spatial period to half 
of the temporal period, w = 2I3t' height of the fluctuating barriers in 
diffusivity (temperature) units, /3 = and the ratio between the slope of 
the average, large scale potential to the slope of the fluctuating perturbation, 
V. In physical terms, u represents the diffusion time over the distance L: if 
uj is large, the particle has time to explore the entire valley of before the 
potential flips. Further, (3 measures the difficulty of crossing the peaks by 
diffusion. Finally, the condition that the perturbation induces local optima 
is \v\ < 1 

Using the rescaled variables, the dynamics becomes 

^ = ^[-^(-Mt) + .] + .^-,. (9) 
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We will use these rescaled variables in the rest of the article, unless noted 
otherwise. From this equation, it is easy to recover the dynamics in the orig- 
inal, non-scaled units by simple multiplications. In what follows we present 
simulation results obtained using first order Euler integration scheme of the 
dynamics defined in rescaled variables, Eq. 



3 Fluctuating potentials enhances diffusion and drift 

Numerical simulations suggest that the behavior oi x(t) at large times is dif- 
fusive, and anomalous scaling is not seen [T51ITBIIT71I18) . We can characterize 
the genotype coordinate motion by an effective drift and a diffusion constant, 
which depend on the spatial and the temporal periods of the fluctuations and 
the barrier height. To characterize the enhancement or the suppression of the 
motion compared to the intrinsic diffusivity and drift, we define 

Doff vart(a;) vart(a;) 



^ {x{t)) L ^ {x{t)) 2uj 
V ~ t vT ~ t vf3' 



(11) 



where the time-dependent means and variances of the trajectories x{t) are 
obtained numerically. As seen in the Fig. [5] both the effective drift and the 
effective diffusion can be enhanced with respect to the intrinsic values, this 
enhancement having a maximum for fluctuation periods comparable to the 
average time to travel between two inflection points. 



3.1 Building intuition 

When /3 ^ 1, the sawtooth peaks are very small, and the diffusion has no 
trouble crossing them. When /3 is larger, the behavior is more interesting. For 
a; — > 0, the particle has ample time to fall into a minimum of before s{t) 
flips. Then when the potential flips, the particle can now go either left or right, 
both with large probabilities, which creates a biased random walk behavior 
with the effective diffusion coefficient ~ L^/(2T), or, equivalently, rn ~ w, 
and the system is only weakly sensitive to the value of v. The fluctuating 
potential allows the particle to diffuse against the drift, so that the speed of 
the evolutionary search is strongly enhanced when the environment oscillates. 

For low UJ, ro w a; is also small, so the diffusion is suppressed compared 
to the internal value. However, for h ^ 1 and without the changing sign of 
s(t), the particle would get stuck at a minimum of almost immediately, 
and the overall diffusion would be, essentially, zero: it is hard to exit a deep 
potential only well with the help of diffusion. Whether is greater or less 
than 1, the fact that oscillations make it nonzero is our most important 
finding, suggesting that temporal fluctuations can make fixation of rare-to- 
fixate mutations a much more common process. Figure [2] demonstrates these 
findings for different values of uj and for /3 = 10 and v — 1/10. 
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Fig. 2 Enhancement of difTusion, ro = ^^fy- (circles) and drift, r„ = ^ (pluses) 

as a function of the relative flipping frequency u> = 25t; with /3 = 10 and v = 1/10. 

At low uj, the particle has time to reach the minima, and Dc« ~ oi ro ~ 
Simulations are averaged over 1000 trajectories and 1000 time steps. Solid line 
indicates ro = ijJ- Error bars are smaller than the symbols. 



When the flipping is fast compared to the diffusion time (large lo in the 
Figure), the fluctuating potential "blurs" together and is effectively zero. The 
only motion is due to the internal diffusion D and ro goes to one. 



3.2 Analytical treatment at /3 — )• oo 

In the limit ^ » 1, the peaks are very high, the particle almost never crosses 
them due to noise, and analytical progress can be made. First consider a 
particle that starts close to a local minimum a;o of the sawtooth. After some 
time ~ IP/u^, which goes to zero as ^ — >■ oo, the particle equilibrates near a;o 
with a probability density 

p(a;|a;^a;o)oce-(i=F^)l^l. (12) 

Then the ratio between the probability, fc>, that a particle is located to 
the right of xq and will move to the right after the potential flips to the 
probability, , that it is to the left of xq and will move to the left is 

When s{t) changes sign, for a small D the particle then glides down with a 
constant velocity in its chosen direction, reaching the next minimum to the 
right (>) or to the left (<) in 

If < 1, then the particle has the time to reach the minimum on either the 

left or the right hand side (assuming, as always, that the sawtooth actually 
forms the local minima, i.e., < v < 1). Then when the potential flips 



7 



the next time, the process repeats. This results in a discrete random walk 
between the extrema of the sawtooth, and (in unsealed variables) 

i^cff= [(fc>+A:<)-(fc>-fc<)2] ^, (15) 

Wcff = (fc> - fc<) ^- (16) 



In dimensionless units, 



rD= [(fc>+fc<)-(fc>-fc<)2]w, (17) 
'vj3 



r„ = (fc>-A;<)^. (18) 



Using Eq. ( 13 ) results in: 

rD = {l-v^)uj, (19) 



2uj 



(20) 



Notably r^) oc — >■ oo when 13 — >■ 0, but ro/ fi — D(,^/h is finite. 

In Fig. [Sj we compare the analytical results to the numerically estimated 
td and (here td is normalized by P/2). As /3 — > oo, the agreement is 
clearly seen for small w. 

When the potential changes faster, and r> > 1 > t<, the particle fails 
to make it to the minimum to the right and, after a subsequent flip, always 
comes back to where it started from. However, it always reaches the left 
minimum before the flip. When r> > t< > 1, it does not reach the left 
minimum either, but goes the distance 2^(1 + 1') to the left, then reverses 
and travels 2^(1 — "y) to the right, reverses again and repeats until it reaches 
the left minimum. After one flip, it moves 2Zj(l"'"''^)' ^-fter three flips it moves 
^(1 + 3w), and so on. Eventually, when /3/(2a;)[(2r7, + l)v) + !]>!, the 
particle reaches the next minimum. Thus every time 2uj/{/3v) crosses an odd 
integer more periods are needed to travel between the nearby extrema, and 
the diffusive behavior changes, resulting in the discontinuities in Fig. [3) This 
dynamics can be described by a master equation 

P,{t + 1) = (1 - ky)P,+^{t - 2n) + k>P,{t - 1), (21) 

where Pi{t) stands for being at an extremum i at the end of the flip t, and 
exactly 2n + 1 flips are needed to travel between the i + I'th and the i'th 
extrema. Solving this for the drift and the diffusion (see Appendix) gives 

l-v 2uj 
"^^^ 'S + v + 2n{l-v)^' ^ ' 

8(1 - 

{3 + v + 2n{l-vW''- 

The analytical results and the numerical simulations verifying them are 
shown in Fig. [sjwith u) normalized by (3/2. 
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Fig. 3 EfTective diffusion (left) and effective drift (right) versus the period of the 
fluctuations. Notice that td is normalized by 2//3, and it remains flnite even if 
D — >■ and /3 — >■ oo. The data are obtained for (in decreasing order of noise 
strength) /3 = 100 (squares), P = 1000 (crosses), /3 = 10,000 (circles), /3 oo 
(solid line, analytical result). In the small noise case, the behavior of the diffusing 
particle is markedly different between Region 1 and Region 2. Region 1 corresponds 
to small u) when a particle can always travel between two extrema of the potential, 
performing an effective biased random walk. Region 2 corresponds to large ui, when 
the particle spends most of the time traveling between minima but rarely reaching 
them. Simulations are averaged over 1000 trajectories and 1000 time steps. 



4 Fluctuating potential shortens the fitness barrier crossing time 

We have shown that the typical diffusive/drift behavior of the system is 
enhanced by the fluctuating component of the potential. However, what kind 
of an effect does this enhancement have on the probability of rare, atypical 
events, such as escape from a suboptimal fitness maximum? 

To model a barrier in fitness, we place the overdamped particle in a 
flipping sawtooth potential and a constant force v, and we observe the mean 
flrst passage time for the particle to reach an unsealed distance LM., against 
the drift, with a reflecting boundary at a; = 0, see Fig.[T] 



4.1 Fluctuation-activated escape from the minimum is possible even at zero 
internal diffusion 

If during one half period the particle is able to travel between the two ex- 
trema, independent of the direction and without the help of the noise, < 1, 
the probability that the particle travels over multiple periods against the (ef- 
fective) drift is flnite even at a very low noise. As seen in Fig. |4j the escape 
time over the average barrier in Uq depends on the length of the barrier Ai . 
In order to understand this dependence, we consider our model in the limit 
of zero fluctuating potential, which allows us to use an analytical expression 
for the escape time |19j 

(24) 



{t) 



D 



D 



1 

2P~e 



-2Pe\ 



4Pe2 
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Fig. 4 Mean first passage times for crossing a barrier of width M in our model 
(simulation, circles) and in a continuous diffusion model with the appropriate ef- 
fective parameters (crosses). The parameters are /3 = 10, a; = 2.5, v = —0.1, and 
they correspond to the leftmost point in Fig. |3] The exit times from our model are 
faster than in the diffusion model. 



where Pe is the Peclet number 



Pe = 



vLM 



2D 



(25) 



In Fig. |4) we show the simulation results of the exit time for slow fluc- 
tuations. We compare the results to what we would have expected under a 
continuous diffusion with the drift and the diffusion constant given by the 
values of the effective parameters as obtained in the previous section. We 
observe that the escape times are well approximated with the "effective" 
continuous diffusion model. Using a simple discrete space model does not 
improve the approximation (not shown). 

The conclusion is valid even for a very small intrinsic noise I? — >■ 0, which 
implies that the average time to escape over the global barrier is fluctuation 
activated (as opposed to noise activated), and is much faster. 



4.2 Fluctuations enhance escape even for steep barriers 

The qualitative behavior of particle trajectories changes if the fluctuating 
potential is fast enough such that the particle can only move less than one 
period in one direction in the absence of the noise. Even though, on aver- 
age, the variance of the particle position grows linearly, and one can define 
a proper effective diffusion coefhcient, the particle never crosses a barrier 
against drift in the absence of the intrinsic noise, /3 — >■ cxd. Hence the proba- 
bility of rare excursions against the effective drift cannot be described using 
the same effective drift-diffusion model. 

Fig. [5] reports results of numerical simulations at different values of the 
additive noise. The escape time as a function of A4 still can be fitted well 



with a "drift-diffusion" model, Eq. (24), with a noise dependent effective 



Peclet number Pe{/3). We conclude that, for small noises, the effective Peclet 
number is approximatively inversely proportional to the noise strength (the 
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Fig. 5 Dependence of the effective Peclet number, PccB = BM on tlie intrinsic 
noise. We simulate exit times for systems of lengths M — 1,2,3,4,5 for different 
/3. For each dataset with the same /3, we performed a weighted least squares fit for 
the average escape time of the form t = A[exp{BA4) — 1 — BA4], fitting for A and 
B. The error bars indicate the confidence bounds of the fits. We show B/jB versus 
/3 decreases sublinearly and reaches a constant at /3 — >■ oo. Thus the mean exit 
time goes to infinity, but it approaches it much slower than for diffusion with the 
fiuctuating potential, for which B/j3 — 0.1 for these parameter values, 2cj//3 = 1, 
V = 0.1. 



plot seems to reach a constant for /3 — > oo). This implies that the escape times 
will become infinite at zero noise. The dependence is consistent with a model 
without any fluctuating potential, but with some effective parameters. The 
parameters are such that, with the fluctuations, the escapes are significantly 
faster. Indeed as shown in Fig. [5] the effective Peclet number, defined as 
Pccff — BA4, is always smaller than the equivalent quantity in Eq. (24 1, 
such that 

■ vL 



2D 



(26) 



5 Discussion 



Using a one dimensional model of diffusion in the presence of a constant force 
perturbed by small periodic fluctuations, we have shown that time depen- 
dent potentials can significantly speed up the large scale drift, diffusion, and 
barrier escape times. This conclusion is valid even for a very small intrinsic 
diffusivity, the long time statistics of the particle trajectories being mainly 
determined by the properties of the potential fluctuations, but not of the 
Langevin noise. 

Our model is a caricature of evolutionary dynamics in the limit of low 
mutation rates and constant population sizes. Even in this limit, there are 
several simplifying assumptions in our model that can be relaxed. 

First, the periodicity of the potential time dependence is not crucial. 
Based on the similarity with Brownian motor models [m[T2] , we expect that 
our conclusions will still be vahd for a nonperiodic s{t): the nonperiodic 
flipping will mix together and average behaviors from the different regions 
in Fig. [sj Further, Dubkov et al. [13] studied a randomly flipping sawtooth 
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with no drift. Their potential flipped with dichotomous Markovian noise with 
rate v. They found an analytic expression for the diffusion enhancement ro- 
it grows slower than in our model for small uj, and the peak of rjj is lower 
and at larger cj. This is consistent with the averaging over different regions 
in Fig. [3} 

Our model is based on a piecewise linear periodic potential with dis- 
continuous first derivatives (sharp minima and maxima). We expect that our 
conclusions stay valid as long as the spatially periodic perturbations are sharp 
enough so that, upon a flip, a particle can leave the vicinity of a maximum 
in a time much faster than a typical travel time between the extrcma. If the 
potential is not periodic, this will introduce a quenched noise and is likely 
to result in emergence of regions in x that are very hard to cross, similar to 

Em- . 

If the assumption of well separated time scales and constant population 
size are not satisfied, the Langevin microscopic dynamics used here is not 
valid any more. Then different fitnesses can give rise to different population 
sizes, and hence to varying fixation rates and to a space dependent D in 
our language, which would require more complex models with position and 
time dependent noise strengths. Such models would modify the probability of 
individual trajectories [20ul8 . and more work is needed in order to identify 
the regimes in which such diffusion models and their predictions apply to 
population genetics dynamics. 



A Diffusion and drift in the no-noise limit 

If it takes 2n + 1 flips to go from site i + 1 to site i, and, going rightwards, one 
returns back in two flips, then 

P^{t + 1) = (1 - b)P,+i{t - 2n) + bP,{t - 1). (27) 

Multiplying by i and summing over it, we get 

{i{t + 1)) = (1 - b)[{i{t - 2n)) + 1] + b{i{t - 1)). (28) 

Assuming that the average can be written as 

{i{t)) = c + «cffi, (29) 

we obtain 

"•=«=l + 2n(r-6) + 6- 
Now multiplying Eq. (27 1 by and summing over i, we get 

{i\t+l)} = {l-b)[{i^{t~2n)}+2{i{t~2n)} + l] + b{i\t-l)}. (31) 
This allows to write for the variance of i at moment t + 1 

(j'^it + 1) = (1 - 6) + (1 - 6)a^(f - 2n) + ba^{t - 1) + 2(1 - b){i{t - 2n)) 
- (1 - b)[{i{t - 2n)) + {i{t + l))]v{2n + 1) 

-2bv[{i{t-2n)) + {i{t + l))]. (32) 
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Now assuming 

(T''{t) = C + Dest, (33) 

we get 

D., = 1(1^^)^. (34) 

(l + 6+(l-6)2n)^ ^ ' 
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